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Abstract 

The rate of convergence of the distribution of the length of the 
longest increasing subsequence, towards the maximum eigenvalue of 
certain matrix ensemble, is investigated. For finite-alphabet uniform 
and non-uniform iid sources, a rate of log n/y/n is obtained. The 
uniform binary case is further explored, and an improved l/y/n rate 
obtained. 
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1 Introduction 



In this paper, we consider the length of the longest increasing subsequence in 
the n-length realizations of general iid sequences with alphabets of size m. As 
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n —* oo, the limiting distribution of the normalized length has direct connections 
to random matrix theory. If the iid sequence is uniformly distributed, Tracy and 
Widom [19] proved that the limiting distribution is that of the largest eigenvalue 
of the m x m traceless Gaussian Unitary Ensemble (GUE); while for general iid 
sequences, Its, Tracy and Widom [ITJ [12] showed that it is the distribution of the 
largest eigenvalue of a direct sum of certain GUEs. 

Limiting distributions in similar problems have also been formulated as Brow- 
nian functionals [2j [6j El [9]. In particular, in [9], the length of the longest in- 
creasing subsequence is obtained as a random walk functional, and the limiting 
distribution, as a Brownian functional. This direct approach allows to explore 
several questions of probabilistic and statistical nature in the longest increasing 
subsequence problem, such as the rate of convergence to the limiting distribution, 
which is investigated below. 

To briefly describe the content of the paper, for general iid sequences we derive, 
in Section U an upper bound of order logn/ ' y/n on the rate of convergence, using 
strong approximation techniques. In the special case of uniform binary sequences 
(m = 2), the rate is sharpened in Section [5] to 0(1/ \/n). 

In previous works, the rate of convergence of certain random walk functionals 
has been investigated. For example, in queueing theory, Glynn and Whitt [6] 
obtained a similar rate via the KMT technique. In that problem, although the 
functional of an m-dimensional random walk is similar, the random walks are 
mutually independent, which is not our case. Moreover, what is meant there by 
rate of convergence is an almost sure upper bound on the deviation between the 
random walk and the Brownian functional. The order of that bound is given but 
its constant factor may depend on the realization of the process. Here, the random 
walks are dependent and, as usually stated, by rate of convergence we mean an 
upper bound on the deviation of the distribution functions. 

Although the Skorokhod embedding of random walks usually provides a rate 
of C(n -1 / 4 ) [16], when the random walk is one dimensional and the functionals 
are the supremum or the local score, Etienne and Vallois [lj obtained a rate of 
0(y/logn/n) using embedding techniques. It is not clear whether or not their 
results can be used or generalized to our problem. 

To start with, we introduce, in the next section, some notation and also sum- 
marize some of the interplay between the longest increasing subsequence problem 
and random matrix theory. 
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2 Longest Increasing Subsequences 

Let Xi,X2, ■ ■ ■ be a sequence of iid random variables with values in the ordered 
alphabet A = {cti, . . . , a m }, where a\ < ct2 < • • • < a m . Let p r = F(X\ = a r ), 
r = 1, . . . , m, with p max = maxi< r < m p r and let also k be the multiplicity of p max 
among the probabilities p r (1 < r < m): 

k = #{r : 1 < r < m,p r = p max }. (2.1) 

Finally, let LI n be the length of the longest increasing subsequence of X\, . . . , X n , 



i.e., 



max 



{j '■ Xi x < Xi 2 < • • • < Xi . , for some 1 < i\ < 12 < • • • < ij < n} . 



Properly renormalized, LI n is known to converge to the maximal eigenvalue of 
some matrix ensemble (see [11] , [12] , [13] , [19] ) . In fact, see [S], 



■4, 



where 



m— 1 



m— 1 



v^max <4 = V" rcr rJ B r (l) + max V] a r S r (t 

m n = tn < u < ■ ■ ■ ^ 



r=l 



= t < h < 

t r = t r -i, r Gl* 



(2.2) 



(2.3) 



r=l 



with cj2 = p r +p r+ i - (p r -p r+ i) 2 , r = 1, 2, . . . , m - 1 and I* = {r : p r < _p max , 1 < 
r < m}. Above, (S 1 (t), i? m_1 (i)) T is an (m — l)-dimensional driftless Brownian 
motion with covariance matrix 



/ 1 

P2,l 



Pl,2 Pi, 3 - - - Pl,rn-1 \ 

P2,3 ■ ■ ■ P2,m~l 



1 



where 



\ Pm-1,1 Pm-1,2 

_ Pr + HrPs 

<j r a s 

_ p s + H r H s 

a r a s 

prps 



1 Pm—2,m—l 
Pm-l,m-2 1 / 



if s = r — 1 
if s = r + 1 

if |r — s\ > 1, 1 < r, s < m — 1, 
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and fi r = Pr — Pr+i, 1 < r < m — 1. 
Next, let 



Hn 



V2 



m—l 



m—1 



— V rB r (l) + max V B r (t r ) 



r=l 



0<ti< 

< tm-1 < 1 



(2.4) 



r=l 



where (B 1 ^), B m ^(f)) T is an (m 
with covariance matrix 



l)-dimensional driftless Brownian motion 



/ 1 

-1/2 



o 



V 



-1/2 

1 -1/2 
-1/2 



O \ 



1 -1/2 
-1/2 1 J 



Comparing ()2.4p and (|2.3[) . it is immediate to see that if the distribution on the 
alphabet A is uniform, that is p r = 1/m, r = l,...,m, then k = m, [i r = 0, 
al = 2/m, and thus J m = H m . Hence, 



LIr, 



n/m 



m 



Let us now briefly recall the connections, originating in [2] and [7], between 
random matrix theory and the Brownian functionals encountered in the present 
paper. 

An m x m element of the Gaussian Unitary Ensemble (GUE) is an m x m 
Hermitian random matrix {Yij}i<ij< m with Ya ~ A^O, 1) for 1 < i < m, 
Re(Y itj ) ~ A(0,l/2) and lm(Y id ) ~~A^(0, 1/2) for 1 < % < j < m, and Y iti , 
Re(Yij), Im(lij) are mutually independent for 1 < i < j < m. 

Writing x^ m ' = (x\, X2, ■ ■ ■ , x m ) £ R m for any m > 1, letting A(x^ m ') = 
Hi<i<j<m(xi — Xj) be the Vandermonde determinant, the following facts hold true. 

First, from [19] and [9], A^ m '°^ = H m , where A^ m ' ^ is the largest eigenvalue of 
the mxm traceless GUE. Using the joint density of the eigenvalues of the traceless 
m x m GUE ([17]. [19]). the distribution function of H m can be computed directly, 
for all m > 2 and all s > 0, as 



(2.5) 



{maxij<s} 
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where A m is the Lebesgue measure concentrated on the hyperplane C m = {x £ 
W 71 : x i = 0}, and where 



m—1 

(0 _1 = / e-^- 1 ^A(x( m )) 2 A m (dx( m )) = (2 7 r)( m - 1 )/ 2 TT 



m—1 

i\. 

i=Q 



Note that ff m is a.s. non-negative, and so P(H m < s) = for all s < 0. 
Second, for all k > 2, can be represented ([9], [10]) as 



J k = H k + ] / 1 k ^ Z, (2.6) 

where Z is & standard normal random variable and, moreover, Hf. and Z are 
independent, while, J\ = \Jl — p max ^- 

The distribution of can be described ([H], [12]) as the largest eigenvalue of 
the direct sum of d mutually independent GUEs, each of size kj X kj, 1 < j < d, 
subject to the eigenvalue constraint YaLi y/Pi^i = 0- The kj are the multiplici- 
ties of the probabilities having common values, the pi are ordered in decreasing 
order, and the eigenvalues are ordered in terms of the GUEs corresponding to the 
appropriate values of pi . 

As shown in |12j . for any k > 1 and all s £ R, 4 has distribution given by 

H-h <s) = c Kpmax j e-M^^+T^^^-i^^A^) 2 ^, 

{maxij<s} 

where 



Below, we study the rate of approximation in (|2.2p and prove (see Section U]) 
that 

logn 



sup 



LJn njW > 3 ;)-F(.7 fr >,-) 



< C(m,fc) 



?i 



where the constant C(m, k) depends only on m and A;. 



3 Upper Bounds on the Density Functions 

Our first results provide upper bounds on the density of the functionals <//% and H^. 
Clearly, since Hk/y/k — ► 2, a.s. (see, e.g., (9J), sup xgR fu k {x) — > +oo as A; — > +oo, 
and similarly for fj.. 
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Proposition 3.1. Let fu k be the probability density function of Hk- Then, for 
any k = 2, 3, . . . , m, 

k 2 /o^5\fc/2 



, , \ kV2 ( k Y „ . /2vrPy /z V2e 



47T 



Proposition 3.2. Let fj k be the probability density function of Then, for any 
k = 2, 3, . . . , m — 1, 



and for k = 1, swp xeR f.h{x) = l/y/2ir(l - p ma x)- 
Proof of Proposition [3721 Using (|2.6[) . for > 1, 



-lll fHkiU) Sj ^- k ^' k z{X ~ U)dU 



supf Hk (u). 



Similarly, for k < m, 



SUp fj (x) < SUp/ fT^T yl z {u) = J 



□ 



Proof of Proposition 13.11 To upper bound the density of H^, consider its 
cumulative distribution function. By (|2.5|) . 

F(H k < s) 

^ , \ i=l Ki<j<fe i=l / 



( 27r )(fc-l)/2 

{maxij<s} 
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and so 

P(s < H k < s + e) 

r ( i k fc-i \ -iEti^f 

/ ex P lE^ 2 E log|st-Xi|-X)log*!j J^yk^jj2 X ^{dx). 



{ s < max £j < s +e } 



(3.7) 



In order to dominate the first term of the integrand in (|3.7p . a bound (see 
A. 6]) going back to Stieltjes, asserts that 

k , , fc 



2 ^ 1 ^ ol ' ^'-4 V /v ' ° ' 2 

8=1 l<i<j<k 1=1 



^Ytf ~ Y ^g\x i -x j \>jk(k-l)(l + log2)-^J2ilogi. 

Hence, 

jY x ^- 2 Y l °e\ x i- x j\ = 2 \lj2 x i- Y lo ^ 



i=l l<i<j<k \ i=l l<i<j<k 



k 



i=l l<i<j<k 



X 2 3^ j 

y ~ y 



— -21og2 



>2^ifc(fe-l)(l + log2)-i J^ilogij -fc(fc-l)log2 

1 fc 
= -fc(jfc - 1)(1 + log2) - J^ilogi- fc(Jfe- l)log2. (3.8) 

i=i 

On the other hand, 

fc-l fc-l i fc-l fc-l 

^logi! = ^^logj = J2( k ~ i) lo g J = klog(k - 1)!- J^ilogi. (3.9) 

4 = 1 j=l J = l J = l 4 = 1 



Combining (|3.8p and (|3.9p leads to 

k k— I. 

1 



I -y k fc-l 



i=l l<i<j<k i=l 



/ fc-l 

< exp — fc(jfe - 1)(1 + log2) + fc(fc - l)log2- Hog(fc - 1)! + 2 ^ilogi + A; log k 



(3.10) 
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Here, using Stirling's inequality 

(fc-1)! > ^(k - 1) (jfe - i)(*-i) e -(fc-i)+i/(i2(fc-i)+i) j 

while 



i log i di = — log k - — + -, 



^ i log i < I 

i=i 



the exponent in (|3.10p can be upper bounded by 
- -k{k - 1)(1 + log 2) + k(k - 1) log 2 - k(k - 1) log (A: - 1) 
-k(-{k 



1) + 12(fc + 1 + log - 1)) + Hog fc 

A; 2 1 
+ /c 2 log A:- — + - 

= ^ + bg2 ^ + bg2 ~ l0g ^ ~ ^ + 1 + bg k ~ 2 1 ) 

+ k Q(l + log 2) - log2 + log(* - 1) - 1 - 12(fc _ 1 1) + 1 + log V27r(fe-l)+logfc^ + i 

^ l2 /log2 , fe \ 5,, , , , /tt 1 
<* 2 ^_|_ + l 0g _ j + _ fc log* + Mog v /- + - ) 

and the bound (|3.10p becomes 

k _ fe-i 

1=1 l<i<j<k 1=1 

-^(^t)" 2 ^ 72 ©" 72 ^- (3 - n) 



Thus, (|3.7I) becomes 

< 



{s<maxxj<s+e} 



On the hyperplane Cl*, the function 



1 _i'p' : x 2 

g 4 Z^i=l 



(2vr)( fc - 1 )/ 2 2( fc -!)/ 2 
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is the probability density function of the (k — l)-dimensional normal distribution 
with mean (0, ...,0) £ R fc_1 and covariance 2Jfc_i, where Ik-i is the (k — 1)- 
dimensional identity matrix. Therefore, 



A fc (dx) = 2^- 1 )/ 2 / — T77— TTTT X k (dx) 



(2 7 r)( fc - 1 )/ 2 v ; 7 (4^)( fc -!)/2 

{s<maxij<s+e} {s<maxij<s+£} 



fc-l „ ~2 



3 {s<Xj<s+e} 



k-1 



< 2 ( fc " 1 )/ 2 y V2e sup = e(k - l)2^' 2 ^. 

P {s<x,<s+e} 4tt 4^ 

Using (13131) . (1X121) yields 

P(s < A* < s + e) 

<s2^(-^Y (k-l)k 5k / 2 (^ "" 



2vr\ K/z ^ 



(3.13) 



\ e J Air 

and the proof is complete. □ 



4 Rate of Convergence Results 

Below, we study the rate of convergence in (|2.2j) and show: 
Theorem 4.1. For any n E N, m 6 N, /or = 2, 3, . . . , m, 



sup 



>x)-¥(J k >x) 



<c(m-l) (m-l)V M + -^aJ * J )^, CI I) 

V \ yPmax V Prnax\L ^Pmax) I I 



n 



where c > is an absolute constant and a max = maxi< r < m _i oy. For k = 1, (4-M) 
holds with the minimum replaced by (p max (l — Pmax))^ 1 ^ 2 ■ 

Remark 4.2. For k = m, the minimum in (4-14) equals 2 fcS '/ 2 / \fp ma x because 
\Jkj [p m ax(l — kp max )] is then understood to be infinite. In general, the minimum 
is equal to 2 k2 / 2 /^/p max if p max > (2 k ' 2 - k)/(k2 k2 ), and ^Jkj [p max (l - kp max )\ if 
Pmax<(2 k2 -k)/(k2 k2 ). 
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In particular, (4.14) implies the following result which should be contrasted 
with Theorems 4 and 6 of [3j. 

Corollary 4.3. If k is fixed and ro->oo asn->ooin such a way that m = 
o(n 1//4 log -1 / 2 n), then 

Lin UPmax t 

. — =>• Jk- 

yWPmax 

Proof of Corollary 14.31 This immediately follows from Theorem 14.11 since 
0-max < 2/m and 1/m < p max < 1/fc. □ 

Proof of Theorem 14.11 Set L n := (LI n — np max ) / y/n, and for i = 1, . . . , n and 

r = 1, . . . , m — 1, set also 

r i 



if Xi = a r 
- 1 if Xi = a r+ i 
otherwise. 



Clearly, Var Z\ = a 2 T and EZT = Hr- With S r Q = and 



i=i 



<7 r 



l,...,n, 



L„ can be written, see the proof of Theorem 3.1 in [9], as 



1 m— 1 



r=l 



5' r 

i T r — + max 

" = jo < h < ■ ■ ■ 

< jm-l <jm=n 
jr =jr-l, r el* 



m— 1 or 
r=l 



+ E n 



n 



where for the remainder term E n we have for any e > 
P(|£n| > e) < e (1 + (m - 1)V 

Letting 



2^2 \ 

max/ 



a; 



n,fc 



1 

m 



m— 1 to— 1 

> r<r r 5 r (l) + max > ov-B 

' = jo < ji < • • • ^ 

< jm-l < jm = n 

j r = jr-l, r e I* 



r=l 



r=l 



n 



we have for any e > 



< 



£71 — H„ 



n.k 



+ . 



max 



(4.15) 



(4.16) 



(4.17) 



(4.18) 
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Using Lemma [4741 and l4~5l below. (|4.18j) can be upper bounded by 

1 + (to - l) 2 o-^ ax / & y /np max \ ^ / cr rV /n 



2 



Now, using Proposition 13.21 

\^{L n /y/p^>x)-¥(J k >x)\ 

< P (IWVp^ - 41 > 2e) + P (x - 2e < J fc < x + 2e) 

< 1 + <" - + (-^) E (l + I^f 



r=l 



+ 4 to - 1 nexp — — — 

V8< ax (TO- iyj 



j 4tt 



(4.20) 



With 

16(to — 1) log n 

the right hand side of (|4.20p becomes 
logn ( 8(to -!)(! + (to -l) 2 aLx) , _i "'" 



f _l + ___i 

^ ,/i 1- 



y/n \ £ logn ^ 1 — |/ir 

+ 4(TO - l) n -( 32 /^ 2 )logn-i^ + | 



64(m-l) f / fc * V (*-l)(**T ^ 

which yields the claim of the theorem. □ 
Lemma 4.4. For any e > 0, 



> e 



\2 2 . 6 , _____ Z' 



m— 1 

<(1 + (to-1) a max )- + exp v ^ _ _ } 
where £ > is an absolute constant. 
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Proof. Comparing (l4~15l) to (|4T71) . 



m—l 



(4.21) 



< \E n \ + V (l + - 

r=l 
m—l 

< \E n \ + 2J2 



r=l 



o r max 

0<j<n 





si 


r max 


0<j<n 















n 



(4.22) 



For any 5 > and < r < m — 1, 



max 

0<j<n 



B r 



n 



>5 



max 

0<j<n 



~S r 1 -B r \j) >5M- (4.23) 



Applying Sakhanenko's version of the KMT inequality [2], [15] to the partial sums 
Sj, j = 0, . . . , n, of the iid random variables (ZJ- — fi r )/o r , i = l,...,n, in turn, 
(I4.23[) can be upper bounded by 



[l + C 2 V^) exp (-Ci<5Vn) . 



(4.24) 



By Sakhanenko, see [18], [T6j Th. 2.1, Cor. 3.2], here C\ = £A r and C2 = A r , where 
£ is an absolute constant and 



A r = sup < A : A E 



Z\ - fl T 



exp < A 



Z\ - fl T 



(7, 



< E 



= Or sup j A : A E ( j Z\ - fir 1 3 exp { A | Z\ - fi r | } ) < Var Z\ } . 
Since \Z\ — fi r \ < 2, choosing A = 1/4 gives 



\ E (\ Z l ~ Mr| 3 exp j - \Z\ - fl T 



E ( (ZT - fir) 2 |Z[ exp^"^ 1 



<E(Vr-/x r ) 2 Iexp{i 
< VarZ[, 
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which implies that A r > cx r /4. Next, for any A > 1/ min{l — fj, r , 1 + fj, r }, 
YaxZ[ = p r (l - fi r ) 2 + p r+ i(l + ii r ) 2 

< Amin{|l - fj, r \, |1 + fi r \} (p r (l - fi r ) 2 +p r+1 (l + fi r ) 2 ) 

< A (p r \l - [l r \ 3 +p r+ i\l + H r \ 3 ) 

< AE (\Z\ - n r \ 



< AE(|Zr-^| 3 exp{A|Zr-^ r |}j , 

which implies that A r < a r j min{l — p, r , 1 + yu r } = cr r /(l — |/i r |). Thus, the upper 
bound (14,241) becomes 



1 + 

Combining <^25\\ and KW\ with (I4T221) . 

/ m- 

<¥[\E n \+2^2<T r 



(4.25) 



r=l 



max 

0<j<n 



or 

J; / 7 



> £ 



m—1 

M/<n|>£)+£ 

r=l 



max 

0<?'<n 
m— 1 



5'' 



5 

n V n 



> 



< | (i + (m - i)VL x ) + £ fi + T 



r=l 



exp 



4a r (m — 1) / 
£<7 r e 



4 4cr r .(m - 1) 



and the proof is completed. 



□ 



Lemma 4.5. For any e > 0, 



H n ,k \/ Pmax J k 

Proof. Comparing (|2T3j) and (|4TT7|) . 



> £ ) < 4(m — l)n exp 



-e 2 n 



m— 1 

< > ( H I u r max sup 

^ V mJ 0<j<n~l < t <i/„ 

m— 1 



^ ( i+t ) -5 r ( - 

n J \n 



< 2 > ay max sup 

J 0<j<n-l <t<l/n 



B r [-+t)-B r [- 
n I \n 



(4.26) 
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Here, for any 5 > and < r < m — 1 



max max 

o<i<n-i 0<t<l/n 

n— 1 / 

<VP max 

^ Vo<*<iM 

n-l 



5 r ( I + t) - B r ( J - 



n 



> 5 



B r (l + t\-B r 



n 



> 8 



- Y2 p (j<f<i > 



i=o 



< ^ 2P(|JV(0,1)| >(5v^) 

< 4nexp (-5 2 n/2) , 



(4.27) 



where, above, we have, respectively, used the reflection principle and standard 
Gaussian estimates for the last two inequalities. Using (|4.26p and (|4,27p . we get 



> £ 



< 



H-n,k \/Pmax Jk 



' m-1 

2 \ a r max sup 

v ~J 0<j<n-l <t<l/r 



B r (l + t )-B T 

n 



> £ 



m— 1 
r=l 

< 4(m — l)n exp 



max sup 

0<J<n-l 0<t<l/r 



n 



B r [L + A-B r 1 J 



n 



> 



2a r (m — 1) 



-£ 2 n 



S^max^- !) 2 



□ 



5 Uniform Binary Sources 

In general, it is not known whether or not the bound in Theorem 14.11 can be 
sharpened to 0(l/y/n). As shown below, with a more direct proof, for binary 
alphabets with uniform distribution this is possible. 

Note that for binary alphabets with non-uniform distribution, that is for m = 2 
and k = 1, the limiting distribution J\ is a normal random variable with zero mean 
and variance 1 — p ms , x - Although the proof of Theorem 14.11 simplifies in this special 
case, it still yields 
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where $ is the standard normal survival function. 

In this section, m = 2 and assume P(Xj = ct\) = P(Xj = c^) 

Let 

1 if X{ = a% 

- 1 if Xi = «2, 



1/2, i G N. 



Zi 



and let Sq = 0, Sk = Y2i=i Zi, k > 1. Define 



Bn(t) 



5, 



ni] 



?i 



+ (nf - [nt])'- 



[nt]+l 



0<t<l. 



n 



Then, e.g., see [8] 



which implies 



Lin ~ n/2 B n (l) g 

2 t 6 [o,i] V ; 



n 



where B is a standard Brownian motion. 



Theorem 5.1. For any n G N, 

LI n — n/2 



sup 



> X 



5(1) 

— — + max 2?(i) > x 
2 te [o,i] - 



< 



24 



Proof. Note that max tg [ 0) i] B n (t) = max^ = o n 



and 



F(m, b) := P max Bit) > m, B(l) < b 

\te[o,l] 



max 5 fc >i,S n < j 
fc=0,...,n 



m,b € 



maxB n (t) > -5=,S„(1) < ^= 

te[o,i] v n v n 



By the reflection principle, for any m > 0, b < m 



i,j G Z. 



F(m, 6) = P max 5(i) > m, 5(1) > m + (m - 6) 

\te[o,i] 

= P(B(1) >2m-b)= 3>(2m - 6), 
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and for any i > 0, j < i 



Fn{i,j) = P max S k > i, S n > i + (i - j 

\k=0,...,n 

= P( S „>2 i - J -)=*»(2^--^ 



where 

*(*) = P(B(1) > z), ^ n (z)=F(S n /V^>z), z£R. 
As well known, e.g., [20J, 

sup|*(z)-*„(z)| < (5.28) 
Next, the joint probability density function of (max tg [ ,i] B(t), B(1)J is 

if m > 0, b < m, and zero elsewhere. For any x > 0, we thus have 
max Li< x )= / / f(m,b)dbdm 

te[o,ii w 2 ; y y 2m _ 2:!; 

= / / 2$"{2m-b)dbdm = -2 / [ §'(2m - 6) ] J^_ 2a . dm 

•/!! J2m-2x JO 

= -2 / $'(m) - $'(2x) dm = 2 $(0) - 2 $(2x) + 2 • 2x $'(2x) 

= 2 <§(0) - 2 i(2sc) - 4x -^e -1 ^- = 1-2 §(2x) - 4x -^e -2 ^ . (5.29) 

\/27r v2vr 



Observe that S n is even if n is even, and S n is odd if n is odd. In the sequel, 
assume that n is even, in the other case the computation is similar and omitted. 
The joint probability mass function of (maxfc=o,...,n Sk, S n ) is then 

p(i,j) = F n {i,j) -F n {i + l,j) - F n {i,j - 2) + F n (i + 2) 

for j even, i > 0, j < i, and zero elsewhere. 
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For any x > 0, with the notation I = [x-*fn\, we thus have 



max B n (t) n ^ - < x 

te[o.i] nW 2 



max Sk < I 

k=0,...,n 2 



21-2 i 

i=0 j = 2i — 2i + 2 
j even 

2i-2 

^ [F n (i, i) - F n (i, 2i - 21) - F n (i + 1, i) + F n (i + 1, 2i - 21)} 

i=0 
21-2 

£ 

i=0 

$„(0)+$n 

- {21 - 2) 



2/ 



i + 2 



2/ + 2 



21 - 1 



21 



2Z \ - {21 + 2 



<!>„(()) + <I>„ ( _ 2 $ n (JL ) - (2/ - 2)P(,S*„ - 2/): 



(5.30) 

where in the last step we used the fact that <& n is constant on the intervals 

by 



-^=, ^=|J, w hen i is a non-negative even integer. 

Let us compare (|5.29p and (|5.3(jp . Since for any x > 0, 2x £ 

(ran . 



21 21+2 



sup 

x>0 



2$(2x) - 2$ n 



21 



sup I 2$(2x) - 2$ n (2a;) I < 



1.595 



x>0 



n 



(5.31) 



Moreover, from symmetry considerations, we know that 



$ n (0) +# n ( -== ) = J + ~P(S„ = 0) + J -P(5 n = 0) = 1- lnS n = 0). 
in I I 2 2 



1 / n 



2 ln/2 



Thus, 

i-(s, ( o) + S,(-L))-ip(4-o) 

Using Stirling's formula 

\/27rn n+ 5e~ n e 12^+1 < n! < v^7r n n+ ^e~ n e^ , 



2- n . (5.32) 



(5.33) 
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and thus the rightmost term in (|5.32j) is dominated by 



n 



n 



_i i l_ _ 1 2 0. 

gl2n 6n+l 6n+l 2 < ^= — < 



-F= < —!=• ( 5 - 34 ) 



Combining (|5,3ip . ()5,34p and Lemma 15.21 below will complete the proof. □ 



Lemma 5.2. For any n £ N, 



sup 

x>0 



4:r 



1 



{2[xyfR[ -2)P(S n = 2[ X y/n\) 



21 

< — • 5.35 

'n 



Proof. First, consider the range x > y/n/Q. In this case, both terms in the left 
hand side of (|5.35p vanish exponentially fast as n — > oo. Indeed, 



4:r 



4= < _JL e -* 2 < * e -n/M. 

2vr v 7 ^ v 7 ^ 7 



Using Vrae""/ 36 < ^/LSe" 18 / 36 < y/18/e, we have 



4x e -2- 2 < 



4 • 1 12 1 



27re y/n Wire Jn 



(5.36) 



If x > y/h~/2 + 1/y/n, P(5 n = 2[xy/n\) = 0. For y/E/6 <x< y/h~/2 + 1/y/n, 
recalling the notation I = [xy/n\, for n/6 < I < n/2, 



»(S n = 21) 



n 

n+2l 



n/2 + I 



n 



\n/2 + n/6y 



n 
2n/3 



(5.37) 



Using Stirling's formula (|5.33p again, (15.37P can be upper bounded by 



n 



n 



V^FV§"3" (|n) 2n/3 (in) n/3 

1 9 



_L 1 J_ __ 

gl2n 8n+l 4ra+l 2 71 



< 



1 



2vr V2n 



(l) 2/3 ti) 1/3 2 



g 540n < 



9 1 



-n/18 



2 ^/n 



Thus, 



(2/ - 2) P(S n = 20 < 



9 1 

2 0r v 7 ™ 



ne 



-n/18 
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Since ne n//18 < 18/e, we have 



81 1 

(21 - 2)F(S n = 21) <——. 

Wire vn 



Hence, (15.36j) and (|5.38p gives the bound (|5.35j) . 

Next, consider the range < x < y/n/6, with the notation Z 
n/6. The left hand side of f)5.35|) can be upper bounded by 



(5.38) 

[xy/n\, < I < 



4.x 



-2X 2 - 



2tt 



4 _L _L e -2(;/v^) 2 



n ^/2ir 
+ 



4-?= -^L e - 2 (V^) 2 - (21 - 2) F(S n = 21) 



(5.39) 



Since the function xe is monotone on the intervals [0, 1/2) and [1/2, oo) 



4;r 



1 



-2ar 



I 1 



2tt 



9 -2(l/0i) a 



< 

< 

< 
< 



4 




V^ 1 




4 




V^ 




4 


1 - 




\/n 


4 


1 


\/2vf 





J L 1 



+ — L= ) c 2 v» 

n 

1 \ _2('-^- + ^- N 

_| I g VV" \Av 



4 I 



-2(i/VS) 2 



27r vn 



4 / _ 2 (' +i N 



27r Vn 



(5.40) 



On the other hand, 



V" V^vf V2vf 



< _±_ _L ,-2(z/v^) 2 



27T V n 

4 Z 



_l | e v \A» v 7 "/ 

27r \\/n -v/n. 



2-7T V n 

4 Z 
< — = -^e~ 



_ 4Z _ 2_ 

g n n 



4 1 _ 2 (_J + 



27T Vn 



2« 2 /n (1 _ e -- 



4 1 



(5.41) 

'27T V™ v ' V2vr V n 

Using 1 - e _< < i (t G R) with i = 6Z/n, and also te~* < 1/e (t £ R) with 
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t = 2l 2 /n, the right most term in (15,4ip is dominated by 



12 1 2V 



-2l 2 /n 



A 1 



2ir y/n n 



< 



< 



12 



\Z2lr \/n 
4 \ 1 



ev27r v27r 
3 A 4 1 
e J J2~k \fn' 



n 



(5.42) 



From (|5.40p and ()5,42p we get the following bound for the first term in (|5.39p : 



4.x 



2tt 



-2x 2 _ 4 J L_ e -2(//v^) 2 



n V27T 



4 1 , 
: -=-t=. (5.43) 



27T V n 



To control the second term in (|5.39p . let us recall (see, e.g., Feller [5l p. 182]) 



that 



where 



n = 21) 



1 (2i/^T) 2 



y/n y/2lT 



2 e 



3^ _ J_ 

n 2 An 360n 3 



1 , < 2Z 4 1 1 
~" ra 3 An 20n 3 



if Z < n/6. 



(5.44) 
(5.45) 



Hence, for the second term in (|5.39p we have 



I 1 



< 



< 



2 21 



-2(Z/^) 2 



(21 - 2) F(S n = 21) 



2ir yjn 
A I 



e -2(VvM 2 |! _ e e„| + 2 p(S n = 21) 



'2-k yjn 
If I < in 5/8 , (g35]) becomes 

1 1 1 



1 - e £n I + 



4 1 



27T V ra 



3n x / 3 An 360n 3 



< e„ < 



e -2(l/v^) 2 e e r , 



1 1 

+ 



(5.46) 



81 Vn An 20n 3 ' 



2 + 



1 



2 T=R 



|, \z\ < 1, (|5.46p can be upper bounded 



and using \ e z — 1| < max 
by 

y/2n \fn 3^/n y/2~rt \fn 

A 1 



< 



< 



2 4 1a 

H — ;== — 7= esi 



V27f2^/e3^ v 7 ^ \/" 
4-1.23 1 



27T V n 



(5.47) 
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using ze~ < l/(2y/e) with z = Ij^fn. 

If ra 5//8 /3 < I < n/6, let us consider ()5.45|) again and apply to (15. 46ft the trivial 
upper bound 



I 



2ir \fn 



27T V™ 



4 Z + l _2i£+2il 



2vr v 7 ™ 



< 



8 



6V2vr V n 



1 _2i£+2i 4 



(5.48) 



In this range of Z, it is easy to show that -2L + ^ < -^n 1 / 4 , thus (|5.48p is itself 
dominated by 



1 



:lie 18' 



6\/2vf ^/n 

Using ne -351 * 1 ' 4 / 18 < (72/35e) 4 , we further get the upper bounds 



S 



72 



1 , 0.44 1 



6\/2~7r V 35e / V 7 ^ \/2lr ^/n 



(5.49) 



Since (foT4T|) is larger than ([5Tl9|) . when < x < ([5^3]) and (pT4"T|) give 

the following upper bound for (|5.39|) : 



4.r 



+ 



< 



2vr 
Z 1 



e -2* 2 _ 4 



i 1 



-2(*/V^) 2 



v 7 ™ v 7 ^ 



V 7 ^ \/2~7T 

4-2.23 1 



- 2 (;/V^) 2 



(2/ - 2) F(S n = 21) 



'2tt \/n 

which is less than what we had obtained for x > y/n/6. 



□ 
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